Skip to main content

7. Pipeline Monitoring and Documentation

Dashboard​

Users can view pipeline execution status in the dashboard. Any failures (with reasons) are reported in the dashboard.

  • In addition to completed and failed runs, users can view scheduled and in-progress pipeline runs.

  • Failed runs can be retried from within the dashboard.

Pipeline execution dashboard showing completed, failed, in-progress and scheduled runs with retry option for failures

Pipeline Failure Alerts​

Under Settings > Notifications, users can add email IDs to receive failure alerts. Failure alert emails contain the error reason.

Pipeline Documentation​

Under Settings -> Documentation, all pipelines are auto-documented and updated in real-time with the details of pipeline name, data source, schedule and storage locations.

Auto-generated pipeline documentation page listing pipeline name, data source, schedule, and storage locations